According to Jeff Dean on X, Gemini 3.1 Flash Lite is significantly faster in tokens per second than the older Gemini 2.5 Flash and completes complex tasks with roughly one third the tokens used in the comparison shown. As reported by Jeff Dean, the side-by-side demo indicates higher accuracy alongside speed and token savings, implying lower latency and reduced inference cost for production workloads. According to Jeff Dean, the reduced token usage can cut API spend and improve mobile and edge deployment efficiency where context windows and bandwidth are constrained. As reported by Jeff Dean, these gains suggest opportunities for upgrading chatbots, agents, and RAG pipelines to achieve faster response times, better user experience, and higher request throughput on existing infrastructure.

According to Jeff Dean on X, Gemini 3.1 Flash Lite delivers significantly higher token throughput and uses roughly one third the tokens to complete the same complex task compared with Gemini 2.5 Flash, based on his posted side-by-side speed and accuracy video comparison. As reported by Jeff Dean, the new model’s faster tokens-per-second and lower token usage indicate reduced inference latency and cost per task for production workloads, enabling cheaper summarization, agent loops, and multimodal reasoning at scale. According to the source video by Jeff Dean, the accuracy holds while token consumption drops, suggesting improved planning and compression that can cut prompt and output spend for enterprises deploying high-volume chat, RAG, and automation pipelines.

According to @godofprompt, Anthropic has introduced code execution with MCP, addressing one of AI’s biggest bottlenecks—token inefficiency in agent operations (source: Twitter, Nov 6, 2025). Previously, agents would use extensive tokens for every tool call, definition, and intermediate result, leading to context overload and increased risk of data leakage. With MCP, agents now write code to call tools directly, reducing token usage by 98.7% and completing tasks up to 10 times faster. This approach, also referred to as 'Code Mode' by Cloudflare, eliminates context overload and minimizes data leakage, signaling a major shift in AI agent architecture. The business impact is substantial: organizations can deploy more efficient, scalable AI agents with lower operational costs, opening new opportunities in process automation and intelligent workflow optimization.